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Abstract 

Two methods to decompose block matrices analogous to Singular Matrix De- 
composition are proposed, one yielding the so called economy decomposition, and 
other yielding the full decomposition. This method is devised to avoid handling 
matrices bigger than the biggest blocks, so it is particularly appropriate when a 
limitation on the size of matrices exists. The method is tested on a document-term 
matrix (17780x3204) divided in 4 blocks, the upper-left corner being 215x215. 

> 

1 Introduction 

CO 

Singular Value Decomposition has proved to be useful in a wide range of applications, 
where a linear relation is a suitable model for a big number of variables. Its main 
strength is in its ability to abstract most of the meaningfull relation in a much smaller 
subspace [7], [2], [6], [8). 

Even though the calculations are very simple in essence, the method is at its best 
^ when dealing with big dimension matrices of data, and the computational resources to 
^ perform the calculations are often insufficient. 

In this document I propose an algorithm that allows to deal with the matrix by pieces, 
so it does not need to define big matrices or operate with them, but only smaller blocks. 



2 The usual algorithm 

the usual algorithm to perform the decomposition is made in two steps: First, a trans- 
formation is found that takes the matrix to bidiagonal form, and then, the bidiagonal 
matrix is decomposed with a different procedure. 
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2.1 Householder transformations and bidiagonal matrices 



The first step is carried by means as a certain class of symmetrical orthogonal (or uni- 
tary) matrices called Householder transformations [3]. A Householder transformation 
is defined by a unitary vector this way: 



Hr = l n xn — 2(R) R 



(1) 



where R is an unitary vector of dimension (number of components) n, and l nxn is the 
identity with n rows and columns. It is easy to see that the matrix that corresponds to 
this transformation is symmetric, which means that it is not changed by transposition 
(changing rows by columns, and vice versa). That impplies that it is its own inverse, 
e.i., that its square is the identity matrix. 

A householder operation can be found that, when multiplied by the left, turns the all 
but one of the entries of the first column of a matrix into zero, but preserving the sum 
of the squares of the entries of that column. 



lnxn — 2{R) R 
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(2) 



The unitary vector that defines the Householder transformation can be computed 
as having one part proportional to the part that is to turn into zero. Being an unitary 
vector, the proportionality factor can be best represented by some unknown factor X 
divided by the norm of that part of the vector, the square root of the sum of the squares. 
In our example: 
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^d 2 + g 2 + k 2 ^d 2 + g 2 + k 2 ^d 2 + g 2 + k 2 



(3) 



Imposing the condition that it makes the required entries of the vector 0, the un- 
known factor turns out to be: 



X 



+ \J a 2 + d 2 + g 2 + k 2 a + Norm 



2^Ja 2 + d 2 + g 2 + k 2 2Norm 



(4) 



We can express any matrix in block form, separating the first row and column, in 
the same way as the Householder matrix. This latter has a very simple form: 



_ ( Ma M row V row 
\M col (V col y Muock 



1 ( M M col V co i 



M ~ N \M col (V C oiY -A^-i ) x(n-i) + (^-Mo)V*Vy' K) 
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where M is the first diagonal entry of the matrix, and the remaining of the first row and 



first column are expressed by a norm and an unit vector, M row V row and M col {y c , 
would be the norm of the first column, that is N 



^Ml + M 2 



col } 
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col 



Multiplying the matrix M by the Householder matrix by left, we get the following 
result: 



H M M 



N 2 



—M co iM row V row + M co iV co iM b iock 



N V M col M row (M col YM row - NM block + (N - M )(M coi yM col M block 



(6) 



A Householder transformation applied on the right, can have the same effect of 
annihilating all but one of the entries of the first row. But, if we try to get a diagonal 
block matrix using two consecutive Householder transformation, one on the left and 
one on the right, the second is going to turn the zero entries produced by the first into 
other number, thus failing to produce a block diagonal matrix. 
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We can, however, leave one nonzero element in the first column, and two nonzero 
elements in the first row, using on the left a Householder transformation that mixes the 
contents of the rows only from the second element on: 
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Next we can focus on the right-bottom block of the matrix where the zero elements 
have not yet been produced. The right and left Householder transformation for that 
block can be computed, so it will be left with only two nonzero elements in the first row 
and column. Then, the same is done for the remaining block, and so on. 
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The number of steps necessary to bring the matrix to a bidiagonal form has been 2n- 
where n is the lower dimension of the matrix. It is a very fast step. 
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2.2 Iterative diagonalisation 

To take the bidiagonal matrix to a diagonal form is not so easy, and cannot be done in 
a fixed number of steps, but has to be an iterative process. The most efficient method 
for this is the QR factorisation [4j. 

Starting from our upper bidiagonal matrix, the steps to be performed are: 

1 . Construct the orthogonal transformation to bring the matrix to lower triangular 
form, with Householder transformations like the ones we used in the last part, but 
only applied by right. 




Apply the transformation by left as well. The result will be a matrix that is not 
either upper or lower triangular, but has the values more concentrated on the 
diagonal. 



3. Repeat the procedure. 
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All the steps are done with orthogonal transformation, and that ensures that the 
singular values are preserved. In each step, besides, the square of every diagonal 
element are increased with the squares of the other elements in the row. That, together 
with the preservation of singular values, ensures convergence. 



2.3 getting the economy decomposition 

The last procedure yields the two square unitary matrices, and the singular values 
diagonal must be nonsquare. That means that a lot of memory is needed for the uni- 
taries, wich are huge matrices with double precision. A lighter alternative is to compute 
the economy decomposition (T), wich give us just slices of unitary matrices. The left 
one has as much rows as our matrix, but only as much columns as the rank (number 
of nonzero singular values) of the matrix. And the right one has as much columns as 
our matrix, but only as much rows as the rank of the matrix. 

M = UDV t 

U U lranfc 



N 



To compute the economy decomposition, a lesser computational effort is needed. 
Suppose that we have in our matrix more rows than columns, or that we took it to that 
form by transposing it. Then, the symmetric matrix A 1 A will be smaller in dimensions 
than A. We can use one of the usual algorithms to diagonalise it, and get 

A 1 A = VDV 1 (8) 

It is very easy to compute the inverse of square root of this matrix, all that is necessary 
is to take inverses of square roots of the diagonal elements of D. Then, we can express 
our matrix like this: 

A = AiA'AY^iA'AY 1 ' 2 = (AVD- 1 ' 2 ) D +l ' 2 V l = UD +1 ' 2 V l (9) 



V V — l ran k 
UU ^ lrouis W ^ ^-columns (7) 
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It can be easily shown that U = AVD~ 1/2 is a slice of a unitary matrix: 

U*U = (Zr^yU*) {AVD- 1 ' 2 ) = D^V 1 (A* A) VD' 1 ' 2 = D^DD- 1 ' 2 = 1 (10) 

If the square matrix A 1 A hapens to be singular, then V is also a slice of a square 
unitary, and D is smaller, but allways invertible. 

3 Frobenius norm and a better starting point 

Latent Semantic Analysis, and other techniques, are based on the fact that some big 
matrices can be accurately represented only by the bigger terms of their spectral de- 
composition, that is, only the bigger singular values. The usual convention to represent 
the diagonal matrix of singular values is in an ordered form, from the biggest, in the 
first element, to the smallest. 

The matrices are usually rather sparse, and with only some column and row swaps, 
we can take the bigger elements up and to the left, so the matrix is going to be closer 
to the desired form. 

The singular value problem, as the eigenvalue problem, can be seen as a maximi- 
sation of a certain value. The solution of the following problem gives the left and right 
eigenvectors corresponding to the highest singular value: 

LEFT: maximise i^\AA constrained by (\l/||\l/) = 1 (11) 
RIGHT: maximise constrained by ($||$) = 1 (12) 

All along this work, the maximisation of the values in the upper left corner of the matrix 
is going to be used to arrive near to the diagonal form. The first thing that can be done, 
is just arranging the rows and columns to take the higher values to the upper left corner 
of the matrix. 

There is a well known result, that tells us that the Frobenius norm of a matrix [5], 
that is, the trace of its square ||A|| = ^Trace(A l A), is the sum of the squares of the 
singular values, and is as well the sum of the squares of all the elements of the matrix. 

Traced A) = £ (>J.»%,»,,) = ]T(A y ) 2 (1 3) 

If we consider the other square matrix AA l the result is the same, because in that case 
we just swap indexes i and j. With the SVD decomposition of the matrix, we only need 
to remember that a unitary matrix does not affect the trace: 

Traced A) = Trace ((F (Ann (JJD mn V l ) = Trace((D mn YD mn )) = ^(A,,) 2 (14) 

i 

TraceiAA 1 ) = Trace ((*7(£W)V*) (VD^U*) = Trace((D nm YD nm )) = ^(A Jt ) 2 (15) 
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where D mn is a square mx n diagonal matrix with the singular values. 

A vector can be computed with the norms of each row, and the Cartesian norm of 
this vector will be the frobenius norm of the matrix. The same can be done with the 
columns. This two vectors can be used to sort the rows and columns of the matrix to 
get the higher values in the upper left corner. 
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Afther that sorting, a definition of the blocks can be done, with some criterion based 
on those row and column norms. The blocks can be defined, for example, as to put a 
certain percentage of the whole frobenius norm in the first column-block, and a certain 
percentage on the first row-block. 

If only the higher singular values are needed, it is not necessary to decompose the 
whole matrix, but instead two steps can be taken: 

1 . Separate the subspace of the highest singular values from that of the lower sin- 
gular values 

2. Decompose only the block corresponding to the highest singular values 



4 Partial SVD 

In the proposed algorithm, the matrix is prepared so as to have more rows than columns 
(transposed if necessary) and the columns are cut in such a way that a fraction of the 
total square Frobenius norm is enclosed in the first column block. The rows are sepa- 
rated in such a way to have square upper left block. 

Then, each block can be considered separately, and that can require considerably 
less computer resources. 



5 A generalisation of Householder matrices for blocks 

The first thing that can be done, is to generalise the concept of a Householder trans- 
formations to any partition of the rows and columns of the matrix in four blocks. The 
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general form of such a transformation is the following: 

U(l mxm - a)!/* U(3V 



~V VPU* V-„)x(JV-n)^(lmxm + a)yy K °' 

where C/ is a slice of a unitary matrix with n rows and m columns, and V is a slice of 
unitary matrix with N — n rows and m columns. This transformation would beaN x N 
unitary matrix, to be multiplied by left to a matrix with N rows divided in two blocks with 
n and N-n rows, or by right to a matrix with N columns split in blocks with n and N — n 
columns, a and (3 are diagonal matrices of rank m with the property a 2 + f3 2 = l mxm 

This matrix y symmetric and it is its own inverse, two of the properties of a House- 
holder transformation. A householder transformation shifts the sign of only one vector, 
but this transformation can be shown to change the sign of any vector that lies within 
a subspace. This subspace is defined by a set of mutually orthogonal vectors, which 
can be arranged in a column or row block. The matrix can be written also like this: 



h = w - 2 _7^- (v^r^t/* -y^v) 07) 
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A transformation like this can be used, for example, to annihilate a block of a matrix, 
just as in the usual SVD method. Here are the steps to annihilate a nondiagonal block 
by multiplication by left: 

1 . The two relevant blocks, the ones that are going to be transformed to annihilate 
one of them, are decomposed. Full SVD is not necessary, a simple decomposi- 
tion Unitary-Symmetric will do. 

Mi = UijSij = ((AijYAij)) ^ Uij = AijS^ 1 (18) 

2. The unitary factors of the two blocks are taken as the U and V matrices of the 
Householder matrix 

3. If we take the first column of a 2x2 blocks matrix as the relevant blocks, the action 
of the Householder matrix will give in the nondiagonal block: 

' X _ U{ i _ a)U t U(3v t \ / USu A \ / ### 

V/3U* l-V{l + a)V t )\yS 2l A 22 ) \V((3S 11 -aS 21 ) 

(19) 

For this block to be zero, the parameters of the matrix must be: 

a = (lmxm + S 21 (S n ) 2 S 21 y 1/2 (3 = (l mxm - a 2 ) 1 ' 2 (20) 

There is another way of doing it as well, wich will probably take more time, but is based 
on a well known technique: the GSVD: Generalised Single Value Decomposition. 

This is the simultaneous decomposition of two matrices: 

A 11 = UCX t A 21 = VSX t (21) 
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where, in the economy representation, U and V are slices of unitary matrices with the 
same dimensions than those of the other method. X is a square matrix. The matrices 
S and C are square and diagonal, and fulfil C 2 + S 2 = 1. They can be used indeed as 
a and p respectively (C = a, S = f3) in the Householder matrix. 

With this kind of Householder transformations, we can perform a complete (not 
economy) blockwise decomposition of a matrix, iterating the annihilation of the two 
nondiagonal blocks as shown in the figure: 



6 Blocks and the trace trick 

To be able to perform the decomposition directly in the economy representation, a 
version of the eigenvalue (spectral) decomposition is needed. The formula shown for 
annihilating blocks only works multiplied by one side, but it does not work to annihilate 
nondiagonal blocks acting on both sides, as an equivalence transformation. 

For a 2x2 number symmetric matrix, the problem of diagonalising it amounts to 
finding a certain number x that fullfills: 



VMV = i^ _J^)( A B _J^\=D 



D = 



'\{A + B) + ^j\{A-BY + C 2 

\{A + B)-^j\{A-B) 2 + C 2 / 

The condition is better derived from the null elements of the matrix, and is: 



(22) 



(1 - x 2 )B + xVl - x 2 A = xVl - x 2 C + x 2 B (23) 
Defining a = (l-2x 2 ) the condition becomes very simple, because \Jl - a 2 = 1x\/\ - x 2 



aB = \Vl^ 2 {A-C) (24) 



The solution is easily found to be: 



2 V /(A-C) 2 + AB 2 

On the other hand, if the entries of the matrix are suitably sized blocks, the condition is 
a lot more complicated. We can represent the unitary matrix as being constructed with 
blocks x, y and z having the form shown above for Householder matrices. 



UMU* 



x y\ f A B\ fx y 

y* z)\B C)\yt z, ^ (2g) 

xAx + yB t x + xBy 1 + yCy t xAy + yB l y + xBz + yCz 
y l Ax + zB l x + y t By t + zCy 1 y l Ay + zB l y + zCz 
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The noncommutativity of the matrices does not allow for an easy solution as that with 
numbers. Furthermore, to solve the condition for the nondiagonal elements should not 
be possible, except in the 2x2 or 2x3 blocks case, because that could be translated to 
solve analytically a general equation of order higher than five. That, according to Abel's 
theorem, is not possible. 

But there is something we can do, and it is working with traces. We can either 
maximise the trace of the first diagonal block, or minimise the trace of the square of the 
nondiagonal block. 

On the other hand, using slices of the unitary matrices, and their complement (the 
slice that is lacking for the total unitary) we can build an unitary matrix S that allow us 
to isolate just a subspace to work on it, thus reducing substantially the dimensionality 
of the problem. 

S = ft °' !l ° 1 (27) 



u 2 u 2y 

Note that if block {AA) l2 is full rank, then U x would be square and there would not be 

aC/i. 

Applying this unitary transformation to the matrix we get: 



S t (A t A)S 



({U.yiAA^U, (U i y(A t A)i 2 U 1 (U 1 ) t (A t A) 11 U 2 {U^iAA^U^ 

(U.YiAAUU, (C/i)*(A t A) 22 C/ 1 (U.YiAA^U, {U^A* A) 22 U 2 

(U^iAA^U, (U^AA^U, (U 2 y(AA) n U 2 (U 2 )\A A) 12 U 2 

V(C/ 2 ) t (A*A) 21 C/ 1 (U^AA)^ (U 2 y(AA) 21 U 2 (U 2 y(AA) 22 U 2 J 



(28) 

The trace of the first diagonal block can be recovered from this matrix as the sum of 
the first and third diagonal blocks. 

If Ui and U 2 are chosen as the unitaries that take the nondiagonal block (A t A) 12 to 
diagonal form D N , things are very simplified in the above expression 



(U.fiAA^U, = D N (29) 

f(U 1 Y(AA) 11 U 1 

(TLVfAt A\..TT. 

S t {A t A)S 



f(U 1 Y(AA) 11 U 1 (U 1 Y(AA) 11 U 1 D N \ 

(U 1 Y(AA) 11 U 1 (U 1 Y(AA) 11 U 1 

D N {U 2 y{AA) 22 U 2 (U 2 y(AA) 22 U 2 

V o (U 2 Y(AA) 22 U 2 (U 2 y(AA) 22 U 2 J 

(30) 

Now, a transformation should be chosen that maximises the trace of the two first blocks. 
This is accomplished by a transformation that diagonalises the reduced matrix M. The 
computation of such transformation does not represent a big computational cost, be- 
cause of the relatively small size of this matrix. 



a ± y [Mn D N \ f ai P 2 \ _ D 1 



(fa)* (a 2 yj\D N M 22 V/3i a 2 \0 D 



'2 



(31) 



where M u = (U^MnUi and M 22 = (U 2 yM 22 U 2 . 
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The final form of the matrix will be: 



U S (A A)SU 



( Di 


w 





X\ 






Y 








yt 


D 2 


z 







Z l 


M 22 ) 



(32) 



Where: 



W = {a^iU^A)^ X = (p 1 ) t (U 2 ) t (A t A) 11 U 2 

Y = (f3 2 ) t (U 1 ) t (A t A) 11 U 1 Z = (a 2 ) t (U 2 ) t (A t A) 11 U 2 (33) 



and 
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Pi 
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\o 








V 



(34) 



The trace of the two first blocks will now be bigger, because the highest eigenvalues of 
the reduced matrix are concentrated in D x . 

This procedure can be iterated, and each time the trace of the first blocks will be 
bigger. 

'[/icxi C/i C/ift 
C/ 2 /3i U 2 a 2 U 2/ 



total 



= su = 



(35) 



7 An algorithm for block-SVD 

Then, an algorithm can is proposed for block-SVD of a big matrix: 

1 . Make sure that there are more (or the same) rows as columns, or transpose oth- 
erwise. This first steps are performed with the sparse csv triplet representation. 

2. Compute the rows and columns euclidean norm 

3. Order rows and columns in descending norm order 

4. Choose a cutting point for the rows and columns. This can be made in several 
ways. The one tried here is taking the point where at least 2/3 of the frobenius 
norm is in the first column block, and cut the row blocks as to yield a square first 
diagonal block. 

5. Create the blocks the appropriate size 

6. Create the Householder unitary matrix that annihilates block 12 
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7. From that starting point, iterate the maximisation of the trace of block 1 1 of the 
square matrix A 1 A until a certain tolerance 

8. Perform SVD of the first block 

9. This gives an approximation of the eigenvalue decomposition of A 1 A. Multiplying 
the initial matrix (by blocks) times the inverse of the square root (also by blocks) 
the two-block relevant vertical slice of the economy unitary left {U in UDV^atnx 
are obtained. The relevant slice of the other unitary is the first vertical 2-block 
slice of the unitary obtained by iteration (V) 

8 Some results 



A matrix of the occurrences of 3204 words in 1 7780 documents was used. The proce- 
dure of cutting the blocks gave blocks with the following characteristics: 



BLOCK 


ROWS 


COLUMNS 


DENSITY 


SQUARE NORM 


NORM PERCENTAGE 


whole 


17780 


3204 


0.35% 


5125858 


100% 


11 


215 


215 


21.14% 


3323694 


64.84% 


12 


215 


2989 


3.73% 


444596 


8.67% 


21 


17565 


215 


0.51% 


96345 


1 .88% 


22 


17565 


2989 


0.28% 


1261223 


24.60% 



It must be noted that the matrix was cut as to leave blocks 1 1 and 21 with a little 
more than 2/3 of the square frobenius norm. 

The blocks of the matrix A 1 A had the following characteristics: 



BLOCK 


ROWS 


COLUMNS 


DENSITY 


TRACE* 


PERCENTAGE 


whole 


3204 


3204 


0.35% 


5125858 


100% 


11 


215 


215 


100% 


3420039 


66.72% 


12 


215 


2989 


3.73% 


543980 


10.61% 


22 


2989 


2989 


0.28% 


1705819 


33.28% 



(*)The "trace" of the nondiagonal block is not actually a trace, but the sum of its 
singular values. The traces of the diagonal blocks must of course sum up to the total 
trace, so their percentages sum up to 1 00%. The percentage for the nondiagonal block 
is only computed to measure how non-block-diagonal the matrix is. 

The sum of the singular values of the nondiagonal block is going to be called non- 
diagonality from now on. 

To enhance convergence, in every iteration whose number is the square of an in- 
teger, a transformation is included that tries to annihilate the block 12, but is damped 
by \, being n the number of the iteration. This is accomplished by computing matrix a 
and (3 as if the whole nondiagonal block was divided by n. 
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The values of the traces for the first five iterations are shown in the following table: 





BLOCK 1 1 


BLOCK 22 


BLOCK 1 2 


~r i it a i — / ^ \ 

TIME (s) 





3420039 


1705819 


543980 




1 


f\ O A A — 7 — 7 

38641 77 


1261681 


1 44997 


a r~ a 

4.54 


2 


3886512 


1239346 


24666 


105.68 


3 


3888110 


1237748 


6828 


96.09 


4 


3888370 


1 237488 


3838 


105.1 1 


5 


3888479 


1237378 


2183 


107.09 


6 


O O O O I - A A 

3888541 


_j /-^ /-^ — 7 f\ A — 7 

1237317 


1781 


103.88 


7 


o o o o r~ o a 

3888584 


1237274 


A A (~\- ~7 

1 187 


a r\ A A o 

104.18 


8 


3888617 


1237241 


1 143 


105.69 


9 


3888644 


1237214 


822 


103.51 


10 


t~\ r\ i~\ r\ r\ r\ r\ 

3888666 


1237192 


831 


103.91 


21 


t~\ o o o o r\ o 

3888828 


1237030 


r\r\ r~ 

295 


A f\f~\ A ~~ 7 

103.47 


22 


3888836 


1237021 


269 


102.47 


do 


OQQQQyl A 

ooooo44 


i OQ"7n H /I 

1 doi\J\ 4 


^4U 


i u*i.y4 


24 


3888850 


1237008 


211 


102.77 


25 


3888855 


1237003 


175 


102.58 


26 


3888859 


1236999 


158 


101.95 


27 


3888863 


1236995 


143 


101.70 


28 


3888866 


1236992 


122 


101.78 


29 


3888869 


1236989 


103 


101.61 


30 


3888871 


1236987 


91 


101.87 


31 


3888872 


1236986 


75 


101.56 



The criterion used for convergence was that the ratio ^ T orm became 1/10000 of 

3 Norm 11 

its initial value (about 1.16). It can be seen that the trace of the first block is allways 
increased, as expected, but the sum of eigenvalues of the nondiagonal block oscillates 
after some iterations. 

The availability of memory for MATLAB 6.5 does not allow to perform the complete 
SVD decomposition of the matrix, but it is possible to compute the singular values. The 
singular values contained in the first 215 x 215 block then account for 75% of the square 
block of the matrix. 

The first 215 obtained singular values had differences under 1e-10 with those cal- 
culated by the usual algorithm, except for the lowest four. 

9 Aknowledgements 

This work was sponsored by the European Comission under the contract FP6-027026 
K-Space and Foundation for the Future of Colombia COLFUTURO. I would also like to 



13 



aknowledge the valuable guidance of professor C. J. van Rijsbergen and useful advise 
from Mark Girolami in the developement of this work. 



References 

[1] E. Anderson, Bai, C. Bischof, J. Demmel, J. Dongarra, J. Du Croz, A. Greenbaum, 
S. ammarling, A. McKenney, and D. Sorensen. LAPACK Users' Guide, chapter 
Singular Value Decomposition, pages 19-23. Society for Industrial Mathematics, 
1999. 

[2] David Gleich and Leonid Zhukov. Svd based term suggestion and ranking system. 
In ICDM '04: Proceedings of the Fourth IEEE International Conference on Data 
Mining (ICDM'04), pages 391-394, Washington, DC, USA, 2004. IEEE Computer 
Society. 

[3] Gene H. Golub and Charles H. van Loan. Matrix Computations, chapter 5, pages 
209-226. Johns Hopkins University Press, 1996. 

[4] Roger A. Horn and Charles R. Johnston. Matrix Analysis, chapter 2, pages 112- 
117. Cambridge University Press, 1999. 

[5] Roger A. Horn and Charles R. Johnston. Matrix Analysis, chapter 5, pages 112- 
117. Cambridge University Press, 1999. 

[6] Thomas K. Landauer, Peter W. Foltz, and Darrell Laham. An introduc- 
tion to latent semantic analysis. Discourse Processes, 25:259-284, 1998. 
http://lsa.colorado.edu/papers/dp1 .LSAintro.pdf. 

[7] Juan C. Valle-Lisboa and Eduardo Mizraji. The uncovering of hidden structures by 
latent semantic analysis. Inf. Sci., 1 77(1 9):41 22-41 47, 2007. 

[8] P. Wiemer-Hastings, K. Wiemer-Hastings, and A. Graesser. How latent is latent 
semantic analysis? In Proceedings of the 16th International Joint Congress on 
Artificial Intelligence, pages 932-937, San Francisco, 1999. Morgan Kaufmann. 



14 



